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VALIDATING CONTENT OF LOCALIZATION DATA FILES 



Fif»1H nf the Invention 

This invention relates to the use of computer systems and methods to validate 
5 specifications consisting of language and cultural details in a source file, and more specifically to 
validating such specifications contained in a source file through formatting data using extracted 
language and cultural details contained in the file. 

Rark ^-nund of the Present Invention. 
10 In the computer software marketing and distribution industry, it is advantageous to make 

software available for use which reflects the language and culture of the intended users. A locale 
file is typically made available by a developer of a software application to assist in 
accomplishing this. A locale file includes a combination of specifications or settings required to 
configure a software application program for a particular geographic and cultural market. These 
15 specifications typically include a language specification intended to be used to control and 
determine linguistic manipulation of character strings within the application program. In addition 
specifications for countries, regions and territories (collectively referred to herein as "country") 
define cultural conventions that vary with languages, cultures or across countries. An example 
of a cultural convention is a date format identifying in which order the numerals representing 
20 day, month and year appear. Other configuration preferences, such as those used to specify mail 
settings or favorite icons are known in the art, but are typically not included in locale files. 
Ensuring accurate computer application program processing of information according to local 
cultural and geographical preferences relies on correct specifications provided in a locale file for 
a given language and country. In order to ensure the accuracy of specifications which are to be 
25 referenced by program applications, it is desirable to have validation performed on the 
individual localization specifications incorporated in a locale file. Accuracy is expected by users 
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when an application pro-am uses the content of a ,oea.e file for formatting data for presentation 



to users. 



Cnrren. practice includes me conversion of a locale source file containing me 
5 Realization specifications , by a uti.ity program (such as .ocaUef as defined in standard 
1SO/1EC 9945-1:1900 (Institute of Electrical and Electronics Engineers (IEEE) Standard 
1003 2-1990) '-«~"«™ t^oIoev Pottahk Operating § vsjan Msflg f^'*"' She " 
Utilities IEEE Standards 1003.2 and 1003.2a) and suitable compiler (such as one for the C 
p^amming language) from an editable text file form into a locale file object form referred to 
10 herein as "locale object", for use by application programs. If the formatted output of the 
application progmm resulting from using the ,oca)e object, is subsequently found to be no. 
co.ee,, mere is typically a problem with me locale object and its associated .ocale source file 
information. Tne locale source file most be corrected with appropriate required changes, 
.compiled and va.ida.ed again. Visual inspection of ft. results of the output of fte applicator 
15 program resulting fiom using fte >oca>e object may be used or fte result may be 
pneumatically compared wift referee values if known. I. will be appreciated that ft, 
iterative process can require a significant amount of time and effort .o obtain fte desired resnlls. 

The curren. practice of updating the locale source file, recompiling and re-.es.ing has 
20 been found .o be error prone. Changes .o fte locale source file may often introduce new errors, 
not related to language or culture, into the compilation stage. 

The validation process often involves the use of a different environment than where the 
,„ca.e object is intended to b. used, for example, performing the vatidation on a workstation 
25 platform for a locale object intended to be used on a mainframe. In such cases, fte ,oca.e object 
and related programming interfaces of fte mainframe platform cannot be used directly dunng 
validation on the workstation platform. 
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gi.tnmar y of the Pre sent Invention 

The present invention provides for improved methods, programs and computer system 
for validating locale files which overcome the difficulties and shortcomings of the presently 
known practice. The present invention provides for retrieval of language and culture 
specifications intended for use with application programs from a locale source file and validating 
those specifications through testing data formatted using those specifications. The present 
invention obviates the need for compilation of the locale source file. 

In one aspect of the present invention, there is provided a method implemented on a 
computer system for validating the contents of a locale source file comprising information 
arranged by categories, keywords and elements. The method comprising, detecting one or more 
of each of the categories, keywords and elements in the locale source file and extracting one or 
more elements from the locale source file. The extracted element is stored as textual data in an 
element storage area, and a text string of data is then formatted from the textual data. Validation 
is performed on the formatted text string. 

In another aspect of the invention, there is provided an article for use on a computer for 
validating the contents of a locale source file comprising information arranged by categories, 

20 keywords and elements. The article comprises a computer readable signal bearing medium, 
having computer readable instructions to perform method steps of detecting one or more of each 
of the categories, keywords and elements in the locale source file. Additionally, the instructxons 
provide for steps to extract one or more elements from the locale source file, storing the extracted 
element as textual data in an element storage area, formatting a text string of data from the 

25 textual data and validating the text string of data. 



15 
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In a further aspect of the invention, there is provided a computer system for validating 
the language and country information contained in a locale source file, the computer system 
comprising means for detecting one or more of each of the categories, keywords and elements in 
the locale source file. Additionally, means for extracting one or more elements from the locale 
source file, means for storing the extracted element as textual data in an element storage area, 
means for formatting a text string of data from the textual data and means for validating the text 
string of data. 

Other features and advantages of the present invention should be apparent from the 
following description of the preferred embodiment, which illustrates, by way of example, the 
principles of the invention. 

Rrief Descr i ption of the Drawings 

The following figures, illustrate by way of examples, the implementation of 
embodiments of the present invention, in which: 



Figure 
the invention; 



1 illustrates an example of a computer system for implementing embodiments of 



Figure 2a illustrates more detailed components of the system shown in Figure 1 for 
validating contents of a locale file; 

Figure 2b is a flow diagram illustrating a process implemented by the components 
shown in Figure 2a; 
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Figure 3 is a flow diagram illustrating more detailed processes performed within the 
process shown in Figure 2b; and 

Figure 4 is a flow diagram illustrating the category keyword proeess shown in Figure 3. 

nea ped Desrpr''"" " f Preft -rH Fmhodiments 

Figure 1 depiets, in a simplified bloek diagram, a computer system 100 suitable for 
implementing embodiments of the present invention. Computer system .00 has a centra, 
processing unit (CPU) .10, which is a programmable processor for executing programmed 
instructions, such as instructions contained in utilities (utility programs) .26 stored in memory 
108 Memory 108 can also include hatd disk, tape or other storage media. While a smgle CPU » 
depicted in Figure 1, it is understood that other forms of computer systems can be used to 
implement the invention, including mu.tip.e CPUs. .. is also appreciated that the present 
invention can be implemented in a distributed computing environment having a plummy of 
compute* communicating via a suitable network 1 19, such as the Internet. 

CPU 1 10 is connected to memory 108 either through a dedicated system bus 105 and/or 
a general system bus 106. Memory 108 can be a random access sem.condnc.or memory for 
stonng language and culture data for each country m d culture such as locale source file 122 and 
optionally an associated charmap file (language character set file) .24. Chamtap .24 provides a 
binding of the abstract symbolic character entiles used in locale source file 122 wnh the 
underlying concrete .echno.ogy supported by computer system .00. Memory .08 is deplete 
conceptnafly as a sing.e mono.ithic entity but it is well known mat memory 108 can be arranged 
,„ a hierarchy of caches and other memory devices. Figure 1 illustrates mat operating system 120, 
,oca,e source file ,22, channap (language character « files) .24 and uti.ities ,26, may reside m 
memory 108. 
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Operating system .20 provides functions such as device interfaces, memory 
managemen, mufiip.e task management, and the tike as known in the art CPU .10 can be 
suita b,y proved ,o read, .oad, and execute instructions of operating system 1 and 
actions of utititics .26. Computer system .00 has the necessary subsystems and 
components .o imp.emen. testing of ,oea.e fi.es as wifi be discussed .ater. Other programs (no, 
shown) inc.ude server software app.ications in which network adapter 1.8 interacts wtfl, me 
serve, software application to enab.e computer system .00 to function as a network server va 
network 119. 

Genera, system bus 106 supports transfer of data, commands, and other information 
between various subsystems of computer system .00. While shown in simp.tfied form as a sing.e 
bus bus .06 can be structured as multiple buses arranged in hierarchical form. Disp.ay adapter 
, 14 ' supports video display device 1 .5, which is a cathode-ray tube disp.ay or a display based 
opon outer suitab.e display technology. The Input/outpu, adapter 1 .2 supports devices surted for 
input and output, such as keyboard or mouse device ..3, and a disk drive unit not shown). 

magnetic hard disk drive or CD-ROM drive although other types of data storage devices can be 
used, including removable media. 

Adapter 117 is used for operationally connecting many types of peripheral computing 
devices to computer system .00 via bus .06, such as printers, bus adatpers, other computers 
using one or more protocols including Token Ring, LAN connections, as known m fire art. 

Network adapter 1 18 inc.udea a modem mat can be connected to a ,e.ephone line for accessmg 
network 1 .9. Computer system .00 can be connected to another neurit server via a loca. area 
network us.ng an appropriate network protoco, and fire network server that can tn mm be 
connected to the mtemet. Figure . is intended as an exemp.ary representation of computer 
system .00 by which embodiments of the present invention ctm be imp.emented. .. ts understood 
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that in other computer systems, many variations in system configuration are possible in addition 
to those mentioned here. 

Figure 2a illustrates aspects of a simplified embodiment of the invention. Within 
5 computer system 100, locale source file 122 and charmap file 124 are provided as input to and 
processed by utilities 126 (one of a set of utility programs referenced as 126 in Figure 1). The 
utility program 126, in this case, is an intelligent extractor, capable of extracting various details 
from the locale source file 122. Locale source file 122 is a structured file including categories 
which define sections of specifications such as time and date specifications. Within each 
10 category are keywords further segmenting category specifications and finally elements 
associated with the respective keywords as a most granular level of extracted details. An element 
may be composed of one or more values. An example is provided illustrating the contents of a 
category which will be subsequently described in association with Example A. The extracted 
information is made available to formatter 230 along with sample data 228. Sample data 228 is a 
15 collection of character strings, skeletons or templates to which is added extracted locale source 
file data to be processed by formatter 230 in conjunction with the extracted locale file 
specifications from locale source file 122 . Formatter 230 uses the extracted information to 
format the sample data 228 into text strings, of locale formatted information 232, for testing. 
Testing involves examination of the resulting text strings of locale formatted information 232 for 
20 language and cultural correctness. Testing or validating may be undertaken by programmatic 
means or in some cases may also involve visual inspection. 

Referring now to Figure 2b, there is depicted a flow diagram of a process of an 
embodiment of aspects of the invention. The process begins with start 250 wherein the setup for 
25 the validation process is performed making the necessary data and input files available to be 
processed in the system, and on completion, passes control to operation 252. 
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Locale source file 122 and charmap (language character set file) 124 previously referred 
to in association with the subsystem of Figure 2a, are obtained from memory and provided as 
input to the extraction step that follows in operation 254. The various elements of the locale 
source file 122 are then extracted in operation 254 to be used later in operation 256. 

Working with the extracted output from operation 254, operation of formatter 256 
generates the formatted readable text strings using the sample data 228, as previously described 
as part of Figure 2a, and makes the locale formatted information available for use in operation 
258. 

The text strings from formatter operation 256 are tested during operation 258 to 
determine string validity with respect to the specific language and culture specifications. If the 
review during operation 258 was satisfactory, the validation process goes to completion ending at 
operation 262. If the results obtained during operation 258 are not in accordance with the actual 
language and cultural specifications, then the extracted locale source information requires 
correction and the process goes to operation 260. For example, a resultant formatted string of 
"Sunday is abbreviated as dim" when compared with the desired specification "Sun" would cause an 
error to be raised. Error notification may be as simple as recognizing a visual difference or it may 
involve an error message being issued during programmatic testing. The correct value "Sun" 
would be required in place of "dim" . 

During operation 260, locale information changes are provided by testers or 
knowledgeable users involved with the validation and applied to the extracted information, 
previously obtained during operation 254, making updated extracted information available for 
formatting again, starting with operation 256. This process is continued until the formatted 
output is correctly validated. 
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Figure 3 illustrates a flow diagram of an overall proeess for a preferred embodiment of 
the invention. The process is performed on a computer system storing the locale source file, 
using an extractor and making use of appropriate associated rules, patterns and substtttttton 
information (including logic and knowledge of how to interpret a locale source file), temporary 
data of the intemtediate output of the extractor and final results of the process (text stttngs for 
testing). The set of keyboard rules, patterns and substitutions are referred to as keyword 
directives. 

A sample portion of a locale source file conforming to POSK locale source 
conventions, is depicted in Example A, a description of which foUows. POSIX Ucale Source 
Convention is ISO/1EC 9945-1:1900 (IEEE Standard 1003.2-1990) toforfflaSion 
^ T ,„ n ,-^ Oner-T V" HHfei g05!£3 Shell Utilities. ™ Standards 
,003.2 and 1003.2a. The following example of a local source file is used to illustrate an 
application of the invention. 
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Exam ple A 



For English_in_Canada: 



en_CA locale entries for "abday" in LCJTEME 

LCJTIME 

abday "<S><u><n>";\ 
"<M><oxn>" ;\ 
»<Txuxe>" ;\ 
» <Wxexd>" ;\ 
»<Txhxu>" ;\ 
"<Fxrxi>" ;\ 
"<Sxa><t> n 

END LC TIME 



Example output for the weekday abbreviations 

For English_in_Canada, the order and abbreviations 

for the weekdays are: 



Sunday is abbreviated as Sun 
Monday is abbreviated as Mon 
Tuesday is abbreviated as Tue 
Wednesday is abbreviated as Wed 
Thursday is abbreviated as Thu 
Friday is abbreviated as Fri 
Saturday is abbreviated as Sat 



For French_in__Canada: 

fr_CA locale entries for "abday" in LCJTIME 
LC TIME 



.... 

abday " <d> < i > <m> " ; \ 
"<lxu><n>" ; \ 
" <m><a><r>" ;\ 
" <m><exr>" ;\ 
"<jxexu> " ;\ 
» <vxexn> " ;\ 
"<sxaxm> " 



END LC TIME 



Example output for the weekday abbreviations 
For French_in_Canada, the order and abbreviations for 



the weekdays are: 



Sunday is abbreviated as dim 
Monday is abbreviated as lun 
Tuesday is abbreviated as mar 
Wednesday is abbreviated as mer 
Thursday is abbreviated as jeu 
Friday is abbreviated as ven 
Saturday is abbreviated as sam 



A POSK locale source file, is a structured file containing tags and values, is typically 
comprised of data in one or more categories including time, monetae, numeric, collation, 
character classification, and yes/no response. The locale source file portion, depicted in Example 
A, is the time category specification in which the POSK defined locale category tag LCTIME, 
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is used ,o identify .he beginning of the time category speeification and a expending category 
end rag END LC TIME, is used to identify the ending of the time category spec.ficat.on. 
Between the LC TIME and END LCJIME tags is a series of category keywords and assoca.ed 
elements that identifies an attribute of the category specification, which in me case shown, 
identifies fire abbreviated names of the week days. The order of the category keywords rs not 
important. 

The category keyword abday represents a collection of elements, each of which is 
comprised of associated values, associated with the abbreviated names of week days. The senes 
of values in each element is composed of quoted character strings, separated by senucolons, 
continuing from entry to entry using the backslash character to designate each entry as shown m 
the Example A. The last value in the series has neither a comma nor a backslash. 

The validation process, presumes any necessary setup has been performed to make 
required data ready for processing, begins at operation 300 in Figure 3. 

During operation 300, locale source file 122, as previously described and referred to and 
in POSDC format, is obtained and placed into memory for processing. 

Locale source file 122 is examined for proper form and content by searching within the 
file for expected category identifiers during operation 302. The information in the input source 
file is compared with category recognition rules obtained from location 322. These rules include 
requirements for category identifiers including, category identifier patterns (e.g. category start 
and end identifiers). Referring to Example A, an example of a category start identifier of the 
category recognition rules 322 is shown as LCJIME. 
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im nmr easing continues to operation 
f i : c folin d during operation 302, processing wi 
Tf a category match is touna uuimg v F 

3M „ ; ^- — - - ~ *— — be made dunng op 

processing flows to operation 332 where the process ends. 

,• ,04 the keyword wittrin the respective category identified through a 

information rules 322. 

} - fi information 324 contains category keyword recognition rules 

5 category, is shown in Example A of Are locale source file. 

to operation 310 instead, to determine it keywor p 
20 respective category. 

, nn , 06 kevW ord element information extraction begins, 
Dunng extracting *^J^ §pecific element iftforra ation rules, 

keyword by keyword. Dunng byword extraction rules 326 and used to 

patteraS and substitution values are read in fro* i ^ ^ ^ ^ 

25 process the plurality of keywords associated w 

the extractor 

t0 "waflc" through the locale source file data prokrng P 

data. For each matehed keyword the extraction process takes the assocra 
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from the locale source and performs a series of operations removing extraneous information (for 
example, string and value delimiters), then collecting previously separated element information 
into strings (for example, for a weekday element, individual characters are combined to form a 
day of the week name), performing substitutions (for example, a numeric value replaced wrth a 
character) as required. For example, the character string "<sxuxn>";\ the first clement fiom 
abday keyword in Example A, would be reduced to "Sun". Upon completion of the extraction 
process for each element of a related keyword, the process moves to operation 308 to coalesce 
intermediate (previously collected) results. 

During operation 308, keyword related element information is coalesced or gathered 
Mo a logical unit of information, making it ready for further processing. These logical units of 
information, such as a collection of abbreviated weekday names related to keyword abday, are 
placed into a memory location keyword extraction intermediate results 328 and processing moves 
,„ operation 310. For example, the keyword abday in Example A, could produce, m one 
embodiment, a comma separated values vector forma, beginning with me keyword abday, 
followed by elements, each containing the three letter value representations of the seven days of 
the week just extracted. The format would be "abday: SUN.MON.TUE..." 

During operation 310, a check is made for more category keyword, When all keywords 
within the category have been processed the process proceeds to operation 312 otherw.se the 
process is directed to operation 304 to begin the keyword match process again, within the current 
category. 

During operation 312 sample data is formatted using the intermediate results of 
operation 308 stored in keywords extraction intermediate results location 328 according to rules, 
patterns and substitution values contained in keyword text string generation rules 330. The rules, 
patterns and substitution values enable formatter 312 to build output strings for testing. For 
example, if Sun" was one of the abbreviated days of the week stored in location 328, formatter 

CA920010050US1 13 



, 12 w „u,d produce an ou,pu< string such as « * *«— - * 

- w *. — v " ° f EMnple A in fte prev,ous exam ! "! 

lelrce L The examp.e jus, described invo.ves se.ecbngdte appropriate s<n„g for outp 
"unday is abbreviated as" and combining it witb an appropriate extracted intermedtate resu., 
("SUN") by placing it at a predetermined location within the stnng. 

Operations involving more complex examples of paberns man what has been described 
ab0 ve wou,d occur, for example, when dealing with monetary string formatting wheretn a 
pained pattern seuuence of currency symbol, group and decitna, separata wouh. 
Led. The content of keyword exbacrion intermediate results 323 is trerated through y 
formaber 3.2 unri. the content has been exhausted, wherein processing moves to ope^on 3 , 
,„ determine if processing has been performed for a» detected categones The out^f 
formatter 3.2 can be held «emporari.y in an output buffer or other memory locabon (no, shown) 
until all processed information is available. 

Upon completion of proofing information from keyword exbaetion intermediate 
... , Hurino nneration 3)4 as to whether the processing or 
results storage 328, a determmatton ts made dunng operauon 

categories has completed. When processing of all detected categones » complete processmg 
Z to operation 3 , b, otherwise processing moves to operation 302 and the )oca)e source b e 
T22 in memory is examined for more categories. Upon common of the category processmg, 
operation 316 is commenced. 

During operauon 3.6 a). previously prepared information resulhng torn operation 3.2 

file or printer. 

Dunng operation 3.8, me outpu, bom operation 3.6 is tested for corrects. Tearing 
raay be perfonned programmatic* against a desired outpu, or reference set, or may be 
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performed visually by a suitable operator. Testing may be performed by simple character based 
comparator operations in which the output just produced is compared with the content of a 
reference set. The reference set may be composed of character strings containing the desired 
form and content. Visual comparison incorporates the desired output using either prior 
knowledge of the operator or visual cues contained in a fact sheet supplied by the test 
administrator. In any event, when no errors are found, processing moves to completion, ending 
at operation 332. If errors are found, error corrections are provided during operation 320. These 
error corrections may be provided by a programmatic means by identifying differences in the 
output string from a reference set or manually by the operator in the case of visual checking. 

During operation 320 the corrections supplied as outputs of operation 318 are provided 
as input to operation 308, where the corrections are applied to the intermediate results, and 
processing continues from that point. 

Referring to Figure 4, there are depicted operations 304 determining keyword match, 
306 extracting keyword and 308 gathering intermediate results, using information provided in 
324 category keyword recognition rules and 326 keyword extraction rules of Figure 3 to be 
described in greater detail. Having obtained and placed into memory the locale source file (122 
of Figure 1) and located a valid category identifier within the locale source file through category 
match operation 302 of Figure 3, processing is ready to commence with category keyword 
detection operation 400. 



During detect category keyword operation 400, a currently identified category segment 
of the locale source file in memory is scanned, for category keywords. Finding a category 
25 keyword , processing moves to determination of valid keyword operation 402. 

During keyword valid determination operation 402, verification is performed on an 
obtained keyword entry, using information from category keyword recognition rules 324 
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described previous* in as— wtih Figure 3. . If -he keyword is no. a va d key™ d 
pLsing moves ,o operation 420 as a de.ee.ed OT or, o.herwise ft. entry , a vahd keyword 

detected. 

During operation 404, element associated with tine category keyword are detected. 
Upon finding an demon, processing moves to operation 406 where » is «^ 
eLen. found is an end keyword. If the dement found is an end keyword a,, element 

t „ generare .able operation 4.4. .f tire demen, found is no, an end keyword, processntg moves 
p L„n 40S ,o determine if the de.ec.eti denren. is vahd . Element vacation operation 
L „peration4 1 0,oe X tiac,va 1 uesofe 1 e m e„, using keyword faction rn.es or tree tiv. 32 
of Figure 3 .f the element is no. a valid element, processing moves to operation 420 as a 
error. Otirerwlse processing moves to operation 4,0 where me vahti demen, - 
extracted. Upon enaction of me valid Cement during operation 4,0 process-ng mo es to 
ition4,2 where.heprev.ousiyextiaded demen, va,ues are moved m,o an demen,^ 
1 confining a category structure of intermediate resuhs to be subsidy used m tah.e 

Z Per keyword, with .«s associated keyword dement vahtes confined widfin respective 
I tha. row A row may further contain a cd, — g a ,abd in the form of category an 

deration 404 again, iooking for more dements of me categoty keyword to process. ,f an end 

mTperation 4,4 during which a .ab,e — g sample data stnngs (such as unday 
ab hr Led as, and the rdevan, keyword aasciat* da. vdues (again - 
Exampie A, for the extiaded keyword «abday», me firs, dement contams va, es SUN ) 
^ed film me keyword e,emen,s is genera,ed. ,f an end keyword is no, de,ec,ed proccsamg 
continues as described before. 
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Upon generating the table in operation 414, processing moves to operation 416 where 
the table is output to a device, such printer, storage or display, causing processing to end at 
operation 418. 

The preferred embodiment just described processes a locale source file through 
processing steps to detect categories, keyword of categories and elements of keywords contained 
in the locale source file. Finally an extraction steps strips out pertinent values from the detected 
elements which are used for formatting sample text strings. These formatted strings are then 
tested for correctness. The described processes do not require the creation of a locale object and 
the formatted strings are in plain text for easy testing and viewing by the program developer or 
end user of the program. 

It has been shown that the invention reduces the number of steps previously required to 
perform the locale source file specification validation thereby reducing required resources. 
Maintaining the extracted locale source specification in textual format also facilitates, m most 
cases, easier maintenance of applications when compared to that of a locale object file as is 
presently done. 

The concepts of the present invention can be further extended to a variety of other 
applications that are considered to be within the scope of this invention. Having thus described 
the present invention with respect to a preferred embodiment, it will be apparent, to those of 
ordinary skill in the art, that many modifications and enhancements are possible to the present 
invention without departing from the basic concepts as described in the preferred embodxment of 
the present invention. Therefore, what is intended to be protected by way of letters patent should 
be limited only by the scope of the following claims. 
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